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Abstract 

Synchronization is studied in a spatially-distributed network of weekly- 
coupled, excitatory neurons of Hodgkin-Huxley type. All neurons are coupled 
to each other synaptically with a fixed time delay and a coupling strength 
inversely proportional to the distance between two neurons. We found that a 
robust, noise-resistant phase clustering state occurred regardless of the initial 
phase distribution. This has not been shown in previous studies where simi- 
lar clustering states were found only when the coupling was inhibitory. The 
spatial distribution of neurons in each synchronous cluster is determined by 
the spatial distribution of the coupling strength. Phase-interaction proper- 
ties of the model neurons in the network are used to explain why can such a 

clustering state be robust. 
PACS numbers: 87.18 Sn, 87.19 La, 05.40 -a 
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Synchronization of coupled neural networks has attracted much interest. In many parts 
of the central nervous system (CNS), synchronous oscillations have been observed and are 
assumed to be correlated to specific behaviors, cognitive tasks as well as pathological states 
Synchronization in coupled neural networks has been studied theoretically by using 
various neuronal models [[|. It is generally assumed that neurons in the network are pulse 
coupled since real neurons interact with each other only when they generate spikes of action 
potentials. The occurrence of synchrony in a network of neurons is largely determined by: 
(1) the phase-response nature of each neuron, (2) the nature of coupling (e.g. excitatory 
or inhibitory) between neurons, (3) the time delay involved in the coupling. Furthermore, 
the presence of noise can also influence the stability of synchronized states. The fact that 
neurons distributed across a wide spatial range can still synchronize poses an important 
question as to what makes it possible. Many studies have indicated that synchronous states 
can be observed when time-delayed synaptic coupling is predominantly inhibitory 0-§J. The 
influence of other important features such heterogeneity and sparseness in the coupling have 
also been investigated [[j]]. However, conditions for the occurrence of robust, fully or partially 
synchronized states in a network of synaptically coupled excitatory neurons have not been 
fully investigated. 

In this Letter, we address this problem with a large network of excitatory neurons that 
are organized in a two dimensional square lattice in space. We found that, in the presence 
of independent local noise, a robust synchronous clustering state can occur regardless of 
the initial phase distribution. This state is characterized by the clustering of neurons into 
15 synchronized clusters that fire consecutively at a fixed time interval that is one 15th of 
their intrinsic period j|,|5]|| . In previous studies, similar clustering states were found robust 
only with inhibitory mean-field coupling [|],[5|. It is known that excitatory coupling usually 
causes instability to synchronized state. The occurrence of robust synchronized clusters in 
the network of excitatory neurons seems to contradict this well established fact. Our analysis 
provides an intuitive explanation of how this is possible. 

Figure 1 is a schematic diagram of the network consisting of an array of 30 by 30 neurons. 
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This network was originally proposed in an attempt to model the network of an array of 
electroreceptor cells that are distributed on the rostrum of the paddlefish, Polydon Daphnia. 
The distance between nearest neighbors is taken as the unit length. The coupling strength 
between any pair of neurons is inversely proportional to the distance R between them ||. 
The neurons are all identical and are coupled to each other through excitatory synapses 
modeled by an alpha function with a fixed time delay. The model that we use to describe 
each neuron in the network was previously developed for the electroreceptor cells in the 
paddlefish |1Q| , |TT|| , and fL2| . It is a modified Hodgkin-Huxley type model involving four 



ionic currents and a leak current. 
dV 

Cm~^~ = ~Ileak ~ ^Na_spike ~ I K spike ~ ^Naslow ~ I K slow + Isyn + V2DT](t) (1) 

where all the ion currents are expressed in terms of ohm's law I x = g x (V — V x ) (subscript "x" 
specifies each specific ion current involved). Detailed expressions for g x , the gating equations, 
and the parameter values can be found in ||10|| , [|TT|| , and ||12j| . Independent Gaussian white 



noise was added to each neurons with uniform intensity D as described by the last term in 
Eq. (1). Synaptic coupling was excitatory and was modeled by an a function given in 
the following expression. 



N W r 

4» = Ef / (s/r^expi-s/^S^t - s)ds (2) 

j=l fHj J Q 

where Sj(t) = J2k^(t ~ tk) represents the output spike train from the jth neuron firing 
at times t^. The delay between the peak time of the presynaptic pulse and that of the 
postsynaptic current is fixed at r = 7 ms. Rij denotes the distance between the ith and 
the jth neuron (Fig. 1). W(> 0) is a constant denoting the coupling strength. For the 



parameter values used in this model each uncoupled neuron exhibits a stable limit 
cycle oscillation. 

In the absence of noise, the system can evolve into a state of multiple clusters with 
carefully selected initial phase distributions. For example, if the initial phase distribution 
was uniform, a synchronous phase clustering state of 16 clusters can occur. The stroboscopic 



picture of phases for all 900 neurons in Fig. 2(a) shows how the clusters emerge as time 
evolves. Each neuron fires periodically while the 16 clusters fire consecutively at a fixed 
phase difference. This makes the cycling frequency of the averaged electrical activity of the 
network 16 times the frequency of each neuron. 

In the presence of weak noise (D = 10 -5 ), a robust phase clustering state with 15 clusters 
was obtained. Furthermore, the same 15-cluster state was always obtained regardless of the 
initial phase distribution []14 |. All other clustering states that occurred in the absence of noise 



with selected initial phase distributions are no longer robust when noise was introduced. 
With noise, the same initial phase distribution as in Fig. 2(a) evolved into a clustering 
state of 15 clusters (Fig. 2(b)). Simulations further indicated that this 15-cluster state was 
robust in the presence of weak noise. Starting with a fully in-phase- synchronized initial state 
where each neuron fires simultaneously (Fig. 2(c), the synchronization was rapidly destroyed 
and the 15-cluster state eventually emerged. Had there been no noise, this fully in-phase- 
synchronized state would have remained unchanged for the same time duration. Similarly, 
when the system was initiated at a 2-cluster state (Fig. 2(d)) which would persisted in 
the absence of noise was destroyed by the noise and eventually evolved into the 15-cluster 
state, although a longer evolution time was required. We tried many different initial phase 
distributions and found that the same 15-cluster state emerged all the time, although the 
transients and the detailed distribution of neurons in each cluster were different. 

A typical pattern of spatial distribution of neurons in each cluster is shown in Fig. 3 that 
corresponds to the 15-cluster state reached in Fig. 2(b). Three important features of such 
distributions were found: (1) the number of neurons in each cluster was approximately the 
same, i.e. about 60 (=900/15); (2) neurons in each synchronized cluster were almost evenly 
distributed in space; (3) the even distribution of neurons in each cluster also indicated that 
the average inter-cluster distance between neurons is similar between different clusters. 

The results presented here are different from previous studies in networks with mean- 
field type excitatory coupling where phase clustering states cannot persist in the presence 
of week noise (see Fig. 7 in Ref. || and fllBl). Our network differs from the mean- field type 



of coupling because the coupling strength is inversely proportional to the distance between 
two neurons. The question is how this difference makes the robust, noise-resistant clustering 
state possible. Furthermore, why is the 15-cluster state the asymptotically stable one? 
What is special about the fixed phase difference 1/15 ~ 0.067? Here are the conclusions 
reached by the following analysis: the fixed phase difference and the number of clusters are 
determined by the phase-interaction properties between two neurons while the robustness of 
the clustering state is achieved because the neurons in the network self-organizes into clusters 
in such way that the stabilizing inter-cluster interactions are stronger than the destabilizing 
intra-cluster interactions. 

Several important features of the 15-cluster state can be explained by the phase- 
interaction properties between two neurons. Phase-interaction between two neurons de- 
pends on how the neurons are coupled to each other and how each neuron responds to 
interactions between them. These properties are characterized mathematically by the so 
called interaction function that is defined as the convolution between the synaptic current 
i>syn(t) = ^hyn{t) and the adjoint or the phase-response function Z{t) |16[ over one oscilla- 
tion period. 



where g(<p) = H(<p) —H(—(f)) is the odd part of H(<p) and w = W/R is the coupling strength 
between the two neurons. Thus, the phase-lock solutions are the zeros of g(<p) and the 
stability is determined by the sign of g'((j>) (stable if g' > 0, unstable if g' < 0) |n],[nj. The 
g(<f)) and g'(<f)) calculated with the model described by Eqs. (1-2) and the synaptic current 
given by Eq. (2) are shown in Fig. 4(a) for the r value used in Figs. 2-3. There are 7 zeros 
in one complete period of which 3 pairs are symmetric. Thus only 4 possible phase-locking 
states are possible: in-phase (0 = 0) that is unstable, anti-phase (0 = 0.5) that is stable, a 




(3) 



where <p is the phase difference between the two oscillators that satisfies 



d(f) 
~dt 



wg((f>) 



(4) 
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fixed phase difference (0 0.062) that is stable, and an unstable phase-locking state. The 
g'(fa) curve shows that the anti-phase solution is weekly stable but the phase-lock solution 
at = 0.062 is strongly stable. Now we see that the number of clusters and this strongly 
stable phase-locking state is closely related since 0.062 is close to the actual phase difference 
(0.067) in the 15-cluster state. Fig. 4(b) shows that the locked phase difference of this phase- 
locking state increases as the synaptic time delay r increases. This implies that at larger 
values of r, the number of clusters in the robust clustering state should decrease. However, 
this simple explanation does not answer how could the neurons in each synchronized cluster 
maintain their stability and why the 16-cluster state was not the asymptotic state although 
i/0.062 « 16.13 is closer 16 or even 17 but not 15. 

To further demonstrate the robustness of the 15-cluster state we need to study the 
stability of the clustering state based on the phase description of coupled neural network. 
With week coupling, each neuron can be approximately described by their respective phase 
variation fa resulting from synaptic interactions with other neurons. Such interactions are 
characterized by the same interaction function H calculated in Eq. (3). Thus, the network 
can be described by the following 900 phase coupled equations. 

^ = E W i,3 H (<t>3 ~ <f>i)- (5) 

j'=iO¥0 

where Wij = Wj t i = is the coupling strength between the ith and the jth neurons. It 
is hard to use these equations to determine all the possible solutions. However, they can 
be useful in determining the stability of a known solution. Instead of solving the eigenvalue 
problem of the huge Jacobian matrix, we here focus on the stability of the clustering state 
when the phase of a single neuron is perturbed. For simplicity, we assume that the average 
distances between two neurons within and between all clusters are identical (confirmed by 
our simulations), we can derive the equation that approximately describes the time evolution 
of the perturbation of any neuron 5(f) = (pi — $j (where $j is the phase of all neurons in the 
cluster where neuron % belongs). 
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^ » -[w g'(0) +w,Y: 9'{j/n)\5<t>, (6) 

where the intra-cluster coupling strength, w = -J2?=o .< 2 _u Z^%'=i ,•'=£,•' b^~? is the av- 
erage coupling strength between two neurons within one cluster. The inter-cluster coupling 
strength, w x = E™7=Wj) ^ E?=i E"4i is the average coupling strength be- 

tween two neurons in different clusters. In these expressions, n is the number of clusters and 
rii is the number of neurons in the ith cluster. 

Equation (6) is valid for all neurons in the network. Therefore, the stability of a particular 
clustering state is achieved when A = wog'(0) + w\ J2]=i g'{j/ n ) > and the most robust 
clustering state is the one that maximizes A. g'(0) < is generally true for excitatory 
coupling (see Fig. 4(a)). Thus intra-cluster interactions destabilize synchrony in each cluster, 
consistent with the known effect of excitatory coupling. However, the cluster can still be 
stable since g'(j/n) (j = 1, • • • ,n — 1) can be positive (see Fig. 4(a)). For a given number 
of clusters n, if g n = YJjZi g'(j/n) > 0, the n-cluster state is stable if wi/wq > \g'(0)\/g n is 
satisfied. The most robust clustering state is the one with n* clusters where n* maximizes 
A. In the present network n* = 15. 

The analysis indicates that the stability of multi-cluster states with excitatory coupling 
is favored by two conditions: (1) g'(4>) is strongly positive and/or positive for a larger part of 
the cycle (see Fig. 4(a)); (2) w\ > w (e.g. wi : w 9.5e -4 , 9.1e~ 4 in Figs. 2-3), i.e. a larger 
average inter-cluster coupling than average intra-cluster coupling. Both conditions are met 
by our network. Fig. 4(a) shows that our g'(<f)) is indeed positive over a large part of the 
cycle and has two large positive peaks located at = 0.062 and 1 — 0.062. The fact that 
I (/(0. 062) I >> \g'(0) \ not only explains why the asymptotic state has as many as 15 clusters 
but also indicates that this clustering state could still be robust even if condition (2) were 
not met. Spatial decay in coupling strength is crucial for the network to satisfy condition 
(2). It allows the network to minimize wo by scattering the neurons in each cluster far apart 
from each other. This explains why neurons are evenly distributed in each cluster (Fig. 3). 

This analysis shows that when the coupling strength is allowed to differ between different 
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neurons, robust clustering states can occur in networks of excitatory neurons. This result 
is not model specific, although the number of clusters depends on specific features of the 
model and some key parameters such as the delay time r. This results is further supported 
by numerical studies of other neuronal models including the integrate-and-fire model (work 
in progress), provided the conditions outlined above are satisfied. 

The fact that distributed coupling strength can generate robust synchronous clusters may 
have some relevance in understanding the dynamical variations of brain functions. First, 
neurons can join different synchronized clusters depending on how the pattern of coupling 
strength is modified. It is possible that these patterns can be mapped to the functional 
states of the brain. The patterns of synchronized clusters may be used as codes in some 
cognitive tasks. Second, associative memory patterns could be stored in the patterns of 
coupling strength and the clustering patterns could be 'selected' by the coupling pattern. 
Furthermore, these patterns could be modified during learning processes. Such memory 
patterns can be retrieved once the clustering patterns are retrieved through dynamical evo- 
lution. Finally, the large number of clusters (n) in the clustering states makes the average 
electrical activity of the network oscillate with a frequency n times the intrinsic frequency 
of each individual neuron. It is worth noting that a high-frequency network oscillation 
(200Hz, several times the spontaneous firing frequency of a single neuron) was reported in 
experiments on pyramidal cells in the CAl hippocampal region of rats ||19|| . 
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FIGURES 
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FIG. 1. Schematic diagram of a two-dimensional lattice of 30 x 30 modified HH neurons, with 
the black dots representing the neurons (1 to 900), where the coupling strength of the ith and jth 
neurons is W/Rij with Rij as the distance between neurons i and j. 



11 



1 



10 



13r 



s 



11: 



14 



12 



FIG. 2. Typical spatial distribution of neurons in each cluster for the 15-cluster state in Fig. 
2(b). The synchronized pattern labeled 1 to 15 appear consecutively as time evolves. 
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FIG. 3. (a) g{4>) (solid line) and g'(4>) (dashed line) plotted as a function of the phase 4> when 
r = 7ms. The scale of g(4>) is shown on the left side of the figure and that for g'(4>) on the right 
side, (b) Phase difference of stable (solid) and unstable (dashed) states plotted as a function of r. 
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